Comparing Multiple-Choice, Essay and Over-Claiming Formats as Efficient Measures of Knowledge

Accuracy on over-claiming tests (the ability to distinguish real items from foils) has been shown to be a sensitive measure of knowledge in a number of domains. Here we compared the efficiency of the over-claiming technique relative to multiple-choice and essay/short answer techniques. One-hundred and eight first-year undergraduate students completed a psychology knowledge test including items of all three formats. The over-claiming technique exhibited the highest reliability per unit of administration time. The over-claiming technique was also at least as valid as the other two methods, as illustrated by correlations with university grades, verbal ability, and concurrent validities. Results represent further evidence that the over-claiming technique may be an efficient alternative to traditional methods of knowledge assessment including classroom testing.